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Abstract 

We study the transmission of two correlated and memoryless sources {U, V) over several multiple- 
user phase asynchronous channels. Namely, we consider a class of phase-incoherent multiple access relay 
channels (MARC) with both non-causal and causal unidirectional cooperation between encoders, referred to 
as phase-incoherent unidirectional non-causal cooperative MARC (PI-UNCC-MARC), and phase-incoherent 
unidirectional causal cooperative MARC (PI-UCC-MARC) respectively. We also consider phase-incoherent 
interference channels (PI-IC), and interference relay channel (PI-IRC) models in the same context. In all 
cases, the input signals are assumed to undergo non-ergodic phase shifts due to the channel. The shifts are 
assumed to be unknown to the transmitters and known to the receivers as a realistic assumption. Both 
necessary and sufficient conditions in order to reliably send the correlated sources to the destinations 
over the considered channels are derived. In particular, for all of the channel models, we first derive an 
outer bound for reliable communication that is defined with respect to the source entropy content (i.e., 
the triple {H{U\V), H{V\U), H{U,V))). Then, using separate source and channel coding, under specific 
gain conditions, we establish the same region as the inner bound and therefore obtain tight conditions for 
reliable communication for the specific channel under study. We thus establish a source-channel separation 
theorem for each channel and conclude that without the knowledge of the phase shifts at the transmitter 
sides, separation is optimal. It is further conjectured that separation in general is optimal for all channel 
coefficients. 

Index Terms 

Multiple access relay channel, cooperative encoders, interference channel, interference relay channel, 
phase uncertainty, joint source-channel coding, correlated sources. 

I. Introduction 

Incoherence or asynchronism between different nodes of a communication network is an inherent challenge 
to modern communication systems. In particular, there are major factors in wireless systems, such as 
feedback delay, the bursty nature of some applications, and reaction delay, which cause time or phase 
asynchronism between different nodes of a network f20'|. Furthermore, in multi-user systems, interference 
from other sources make synchronization much more difficult. Therefore, it is interesting to study multi-user 
communication problems without assuming synchronism a priori. 



2 



In point-to-point wireless systems, achieving receiver synchronization is possible in principle, using 
training sequences and/or feedback. However, although analytically convenient, full synchronization is rarely 
a practical or easily justified assumption, and in some cases theoretically infeasible 1251 . The first studies of 
time asynchronism in point-to-point communications goes back to the 60's ( lH, ifTOl ). where the receiver is 
not accurately aware of the exact time that the encoded symbols were transmitted. The recent work of |[20l . 
on the other hand, assumes a stronger form of time asynchronism, that is, the receiver knows neither the 
time at which transmission starts, nor the timing of the last information symbol. They propose a combined 
communication and synchronization scheme and discuss information-theoretical limits of the model. Also, 
in multi-user communication settings, the problem of time asynchronism is addressed for example in |[6l . 
||22) for the particular case of multiple access channels. 

Besides time asynchronism ||20l . which is present in most channels, other forms of asynchronism such as 
phase uncertainty are important in wireless systems. In fading channels, the channel state information (CSI) 
models amplitude attenuation and phase shifts (phase fading) introduced by the channels between the nodes. 
In many systems, it is difficult to know phase shifts at the transmitter side due to the delay and resource 
limits in feedback transmission. In particular, in highly mobile environments, fading in conjunction with 
feedback delay may result in out of date phase knowledge by the time it reaches the transmitters (see, e.g., 

ma). 

The issue of phase asynchronism can be analytically seen in the larger framework of channel uncertainty, 
that is, the communicating parties have to work under situations where the full knowledge of the law 
governing the channel (or channels in a multi-user setting) is not known to some or all of them |[T4l . In 
order to study this general problem from an information-theoretic point of view, the mathematical model 
of a compound channel (or state-dependent channel) has been introduced by different authors Q, 191, |[24l . 
A compound channel is generally represented by a family of transition probabilities Py^x^ where the index 
G is the state of the channel and represents the uncertainty of different parties about the exact 
channel's transition probability. 

In this paper, we consider the problem of joint source-channel coding for a range of compound Gaussian 
multiple-user channels with phase uncertainty and prove a separation theorem for each. We assume that the 
phase shifts over channels under consideration are stationary non-ergodic phase fading processes which are 
chosen randomly and fixed over the block length. Thus, phase asynchronism is formulated in the compound 
channel framework and the phase information 6 (as the channel parameter) is assumed to be unknown 
to the transmitters and known to the receiver side(s) as a practical assumption. Consequently, as our main 
contribution, we find conditions that are both necessary and sufficient for sending a pair of correlated sources 
over a class of continuous alphabet multiple-user channels under phase uncertainty. 

The problem of joint source-channel coding for a network is open in general. Several works, however, have 
been published on this issue for multiple access channel (MAC). As an example, for lossy source-channel 
coding, a separation approach is shown in [21] to be optimal or approximately optimal to communicate 
independent sources. In |i5J, on the other hand, a sufficient condition based on joint source-channel coding 
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to send correlated sources over a MAC is given, along with an uncomputable expression for the outer bound. 
As the sufficient condition in Q provides a region greater than that ensured to be achieved by separate source 
and channel coding, it is proved that the separate source-channel coding is not optimal for correlated sources. 
In m, 0, however, the authors show that performing separate source and channel coding for the important 
case of a Gaussian MAC with phase shifts, shown in Fig. [1] is optimal. Namely, in [1] and |2|, F. Abi 
Abdallah et. al. showed the following separation theorem for a class of phase asynchronous multiple access 
channels for both non-ergodic, and ergodic i.i.d. phase fading: 

Theorem 1: Reliable communication over a PI-MAC: A necessary condition for reliable communication 
of the source pair (U, V) ~ rTi^*!^*! ^^^^ ^ class of multiple access channels with unknown phase fading 
at the transmitters, with power constraints Pi,P2 on the transmitters, and fading amplitudes 51,(72 > 0, is 
given by 

H{U\V) <log{l + glPi/N), (1) 
H{V\U)<log{l + glP2/N), (2) 
H{U, V) < log(l + {gjPi + glP2)/N), (3) 

where N is the noise power Sufficient conditions for the reliable communications are also given by O-©, 
with < replaced by <. □ 

Also, the recent work ifTSl addresses the same problem for a phase fading Gaussian multiple access 
relay channel (MARC) and proves a separation theorem under some channel coefficient conditions. For the 
achievability part, the authors use the results of ifTTI . ifTTl . and llT3l based on a combination of regular 
Markov encoding at the transmitters and backward decoding at the receiver ifTll . In particular, in order to 
derive the achievable region for discrete-memoryless MARC, the authors of lITTl use codebooks of the same 
size which is referred to as regular Markov encoding. This is in contrast with block Markov encoding which 
was introduced by Cover and El Gamal in [8] for the relay channel. There, the encoding is done using 
codebooks of different sizes and is referred to as irregular block Markov encoding. 

In this paper, we consider a more general PI-MARC, in which one of the encoders is helped by the 
other one causally or non-causally. We refer to such networks as phase-incoherent unidirectional cooperative 
MARCs or PI-UC-MARCs for short. Furthermore, we also prove separation theorems for a phase-incoherent 
interference channel (PI-IC) under strong interference conditions and phase-incoherent interference relay 
channel (PI-IRC) under specific strong interference gain conditions. 

The networks that we consider and for which we prove our results are Usted as follows: 

• PI-UC-MARC with non-causal (NC) cooperation between transmitters and with strong path gains 
from transmitters to the relay. We refer to this network as phase incoherent unidirectional non-causal 
cooperative (PI-UNCC)-MARC. By removing the relay, the results can be specialized to the case of a 
MAC (PI-UNCC-MAC). 

• PI-UC-MARC with causal (C) cooperation between transmitters and with strong path gains from 
transmitters to the relay. This network is called a phase-incoherent unidirectional causal cooperative 



4 



(PI-UCC)-MARC. By removing the relay, the results can be specialized to the case of a MAC (PI- 
UCC-MAC). 

• Phase incoherent interference channel (PI-IC) in strong interference regime. 

• Phase incoherent interference relay channel (PI-IRC) in a specific strong interference regime with strong 
path gains from transmitters to the relay. 

We show that if the phase shifts are unknown to the transmitters, then the optimal performance is no better 
than the scenario in which the information sources are first source coded and then channel coded separately, 
i.e., the correlation between the sources is not helpful to enlarge the achievable region, as opposed to 
cases where the transmitters have knowledge of the phase shifts and could potentially use beamforming, for 
example, to joint source-channel code the data and achieve higher rates. Although we assume non-ergodic 
phase shifts throughout the paper, as in [2|, our results are also true for the ergodic case, where the phases 
change i.i.d. from symbol to symbol. The contributions of this work are stated in the form of four separation 
theorems that are given in the following sections. 

Further, we conjecture that optimality of separation is true not only for the specific gain conditions we state, 
but also for all possible values of path gains. Hence, we conjecture that separation is optimal for unrestricted 
forms of the phase incoherent Gaussian phase fading channels discussed in this paper. The approach we 
used here to prove the separation theorems which is based on computing necessary and sufficient conditions 
for reliable communication, however, may not be viable to prove the conjecture. 

The rest of this paper is organized as follows. We introduce the phase asynchronous multi-user networks 
considered in this work in Section |ll] along with a key lemma that we use several times in the paper. In 
Section JIIJ we define the general problem of the joint source-channel coding for a PI-MARC and state 
a separation theorem for it. In Sections |IV] and |Vl we state and prove separation theorems under specific 
gain conditions for a class of phase asynchronous MARCs in which the encoders cooperate unidirectionally 
both non-causally and causally respectively. Next, In Sections |Vl] and I VIII we consider joint source-channel 
coding problem for interference channels and interference relay channels under phase uncertainty respectively 
and likewise state and prove separation theorems for them under strong interference conditions. We finally 
conclude the results in Section IVIIII along with a conjecture. 

II. Network Models and a Key Lemma 

Consider two finite alphabet sources {Ui,Vi} with correlated outputs that are drawn according to a 
distribution P[Ui = u,Vi = v] = p{u,v). The sources are memoryless, i.e., (C/i,Vi)'s are independent 
and identically distributed (i.i.d). Both of the sources are to be transmitted to the corresponding destinations 
through continuous alphabet and discrete-time memoryless non-ergodic Gaussian channel models. Channels 
are parameterized by the phase shifts that are introduced by different paths of the network which are, as 
a realistic assumption for wireless networks, not known to the transmitters. The vector denotes the non- 
ergodic phase fading parameters. For simplicity, throughout the paper, we assume that transmitter node with 
index i G {l,2,r} has power constraint Pi and the noise power at all corresponding receiving nodes is N. 
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Fig. 1. Correlated sources and phase incoherent multiple access channel. 

In the models that we consider, the receiver(s) are fully aware of 6. However, the transmitters do not have 
access to the channel state information (CSI), 6, but only the knowledge of the family of channels over 
which the communication is done and the code design must be robust for all 0. Such channels are referred 
to as compound channels 191, ll24l . Nevertheless, in order to avoid ambiguity, we call the particular channel 
under consideration a phase-incoherent (PI) channel with correlated sources. In the sequel, we introduce the 
channel models to be considered in this paper. 

A. Multiple Access Channel (MAC) 

A phase incoherent multiple access channel (PI-MAC) {Xi x -Vj, 3^,pe(y|xi, a;2)) with parameter 6 = 
(01,92) G [0, 27r)^ is illustrated in Fig. [T] The MAC is described by the relationship 

Y, = hiXu + h2X2i + Zi, (4) 

where Xii,X2i,Yi € C, CJ\f{0, N) is circularly symmetric complex Gaussian noise, hi = gie^^^ , /12 = 
526-^^^ are non-ergodic complex channel gains, and parameter 6 represents the phase shifts introduced by 
the channel to inputs Xi and X2, respectively. The amplitude gains, gi and g2, are assumed to be known 
at transmitters and can model e.g., line of sight path gains. 

B. MAC with Unidirectional Non-Causal Cooperation Between Transmitters (UNCC-MAC) 

A PI-UNCC-MAC {Xi X X2,y,P0{y\xi,X2)) is depicted in Fig. [2] The first encoder Xi has non-causal 
and perfect knowledge of the second source V. The channel characteristic is the same as an ordinary PI-MAC 
given in (|4]|. 

C. MAC with Unidirectional Causal Cooperation Between Transmitters (UCC-MAC) 

Another multi-user model that is considered in this paper is a cooperative variation of the multiple access 
channel {Xi x X2,yi x y,pe{yi,y\xi,X2)) where one of the transmitters can play the role of a relay for 
the other. This channel model is shown in Fig. [3] where the first transmitter (node indicated by Xi) can 
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Fig. 2. Correlated sources and phase incoherent unidirectional non-causal cooperative multiple access channel. 




Fig. 3. Correlated sources and phase incoherent unidirectional causal cooperative multiple access channel. 

help the second transmitter (node indicated by X2) to transmit its information to the destination. However, 
node 2 cannot help node 1 and thus we refer to such a channel as a unidirectional cooperative MAC. The 
received signal of the PI-UCC-MAC at the destination is also given by (|4]). At the transmitter/relay node, 
node 1, we have 

Yu = <?2ie^'^-X2, + Zu, (5) 

where 521 and 621 are the path gain and the phase shift of the channel from node 2 to node 1 respectively. 
The vector 6 for the PI-MAC has three elements and is defined as 6 = {61, 62, O21). 

D. Multiple Access Relay Channel (MARC) 

A multiple access relay channel is a network with four nodes, two transmitters, a relay and a destination. As 
depicted in Fig. |4l in a MARC with phase fading {Xi x X2 'x Xr,y ,pe{y,yr\xi,X2,Xr)), two transmitters 
wish to reliably send their information to a common destination, with the help of a relay. There are five 
paths in the network. The phase parameters are not known to the transmitters and hence we refer to the 
MARC as PI-MARC. The received signal at the destination is given by 



Yi = hiXii + h2X2i + hj-Xr + Zi, 



(6) 
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Fig. 4. Correlated sources and phase incoherent multiple access relay channel. 

where Xu, X2i,Yi G C, ~ CAf{0, N) is circularly symmetric complex Gaussian noise, hi = gie^^^ , /12 = 
g2e^^'^,hr = grG^^'' are non-ergodic complex channel gains, and 61,62, Or represent the phase shifts intro- 
duced by the channel to inputs Xi, X2 and Xr, respectively. 
Moreover, the signal received at the relay can be written as 

Yri = hirXii + h2rX2i + Zir (7) 

where Zir ~ CM{0, N) and hir = girG^^^'', /i2r = g2re^^^'' are the complex path gains with unknown phases 
6ir,62r at transmitters. The parameter 6 = {6i,62,9r,6ir,62r) e [0,27r)^ of the PI-MARC includes all of 
the fading phases in different paths. 

E. MARC with Unidirectional Non-Causal Cooperation Between Transmitters (UNCC-MARC) 

An important multi-user network that we consider is a unidirectional cooperative MARC, in which the 
first encoder has non-causal access to the second source V. Indeed, UNCC-MARC is a UNCC-MAC with 
a relay. The channel model is similar to an ordinary MARC, but the setup of the sources and encoders are 
different. Fig. [5] depicts a PI-UNCC-MARC. 

Like PI-MARC, the input/output relationships of the channel for the receiver and the relay are given by 
^ and ©. The parameter 6 is the same as that of the ordinary MARC. 

7^ MARC with Unidirectional Causal Cooperation Between Transmitters (UCC-MARC) 

We also consider sending sources U, V over a PI-MARC with causal unidirectional cooperation between 
the encoders denoted by {Xi x X2 x Xr,yi x x y,P0{yi,yr,y\xi,X2,Xr))- As it can be seen from 
Figure |6l the encoder Xi does not have non-causal knowledge about V, but it receives a noisy phase 
faded version of X2 through the link from node 2 to node 1. Again, Q and ([7]) describe the input/output 
relationships of the channel for the receiver and the relay. Additionally, the relationship 

Yu = 52ie^'^-X2i + Zii (8) 

describes the cooperative link from node 2 to node 1 which completes the definition of a PI-UCC-MARC. 
The parameter 6 for the PI-UCC-MARC is the vector 6 = {6i,62,6r,9ir,92r,6i2). 
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Fig. 5. Correlated sources and phase incoherent muUiple access relay channel with unidirectional non-causal cooperation between 
the encoders. 




Fig. 6. Correlated sources and phase incoherent multiple access relay channel with unidirectional causal cooperation between the 
encoders. 

G. Interference Channel (IC) 

Another network model we consider in this paper is the two-user interference channel with strong 
interference. A continuous alphabet, discrete-time memoryless interference channel (IC) with phase fading 
is denoted by {Xi x -^2,3^1 x 3^2 02(^1' 2/2 1 2^1, 2^2 )) and its probabilistic characterization is described by 
the relationship 

Yu = 5iie^'"Xi, + 9216^'" X2^ + Zu, (9) 
= 9i2e^'''Xu + g22e^'''X2^ + ^2^, (10) 

where Xu, X2i,Yi £ C, Zi CN'{0,N) is circularly symmetric complex Gaussian noise, gu, gi2, 921, 922 
are non-ergodic complex channel gains, and parameters 61 = [On, 621) € [0,27r)^, 62 = {612,022) S [0,27r)^ 
represents the phase shifts introduced by the channel to inputs Xi and X2, respectively. Figure |7] depicts 
such a channel. We refer to the IC defined by ^ and ([TOl l as PI-IC if we assume the phase shift parameters 
01,62 are not known to the transmitters. 
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Fig. 7. Correlated sources and phase incoherent interference channel 




Fig. 8. Correlated sources and phase incoherent interference relay channel 

H. Interference Relay Channel (IRC) 

The last network model we consider is an interference channel with two transmitters and a relay referred 
to as interference relay channel (IRC), depicted in Figure [8] Again, we consider phase fading at all paths, 
unknown to the transmitters and thus call the channel a phase-incoherent IRC (PI-IRC). The PI-IRC {Xi x 

X2 X '^r,yi X 3^2 X yr,Pe{yi,y2,yr\xi,X2,Xr)) is described by relationships 

Y2i = gue'^^'^Xu + 5226^'^^^ ^2i + 9r2e^^''Xri + Z2i, 
Yri = gire^^'^-Xu + g2re^'^'^X2^ + Zri, 

where Xii,X2i, Xri, Yii,Y2i, Y^ £ C, Zu, Z2i, Z^ ~ CA/'(0, A^) are circularly symmetric complex Gaussian 
noises, g\\^ g2i, gri, 5i2) 522) 5r2 are non-ergodic complex channel gains, and parameter 6 = {9ii, 621,0^1, 
012, ^22> ^r2i Oir, ^2r) £ [0, 27r)^ represents the phase shifts introduced by the channel to inputs Xi, X2 and 
Xr, respectively. 
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/. Key Lemma 

Definition 1: Let X = {Xi,X2, ■ ■ ■ ,^m), be a vector of random variables with joint distribution px 
and max, ^\X^f < oo. Also let the scalar RV F = YlZi die^'^'^i + where giC^^^ are arbitrary complex 
coefficients and Z ~ C7V(0, N). □ 

We now state the following lemma which asserts that the minimum over = (^i, 6*2, • ■ ■ ; Gm) of the mutual 
information between X and V, is maximized when X is a zero-mean Gaussian vector with independent 
elements, i.e., RVs Xi,X2, ■ ■ ■ ,X„i are independent Gaussians with zero mean. 

Notation: For convenience, we denote the mutual information between X and V by 

m 
i=l 

Lemma 1: Let V = {px ■ mXi\\^ < Pi,\/i} and e V he a zero-mean Gaussian distribution with 
independent elements and E|[Xj|p = Pi,yi. Then, 

maxmmBeipx) = log f 1+ V5fP»/iV ) = Bg{p*^), 

i.e., when 6 is chosen adversarially, the best X is a zero-mean Gaussian vector with independent elements 
and Var(Xi) = Pi,Vi. □ 
Proof: 
By definition, we have 

Be{p^) = Kgie^^'Xi + 526^'^^ ^2 + • • • + QNe'^^Xm + Z) - h{Z). 

By letting E(XjXj) = pij^PiPj, it can be easily seen that the RV V has a fixed variance ay which is 
equal to 

(m \ 
Y^afPr +N + 2Y,9i9j^PPj ft{pije^^''-'^^}. (11) 
2=1 / i<j 

Using the fact that for a given variance ay, the Gaussian distribution maximizes the differential entropy 
h{V) |7|, we can bound Bq{px) as 

Se(px) < I log(2^e4) - h{Z). (12) 

Next, note that mingay is maximized when pij = 0,Vi,j. It can be seen from ([TT] ) that if pij / 0, the 
parameters 61,62, ■ ■ ■ ,6 m can be chosen such that the term '2'Yli<j 9i9j\/Pi^j ^^j/Oije-'^^'"^^^ } is strictly 
negative. Therefore, independent Gaussians {pij = 0,\/i,j) maximize the right hand side of (fT2l ) and the 
lemma is proved. ■ 

Remark 1: For the ergodic setting, where 6 is i.i.d. from channel use to channel use, uniformly distributed 
over [0, 27r)™, and the averaged mutual information over 6 is to be maximized, a similar result is given in 
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IfTTl Thm. 2]. Specifically, 

uiaxEeBeipx) = log (^l+f^g^Pi/N^ . 

□ 

III. Phase Incoherent Multiple access Relay Channel 

In this section, we formulate the problem of source-channel coding for the PI-MARC introduced in Section 
III-Dl and state a separation theorem for it ||T5T|. The definitions and problem formulation given in this section 
will be of use for the other networks in the paper. 



A. Preliminaries 

Definition 2: Joint source-channel code: A joint source-channel code of length n for the PI-MARC 
introduced in Section III-DI with correlated sources is defined by 

1) Two encoding functions 

(Xii, Xi2, • • • , Xin) = ^ 
ix2\,X22. ■■■ , X2n) = X2 :V" ^ X2 ^ 

that map the source outputs to the codewords. Furthermore, we define relay encoding functions by 

Xri = fiiyrl,yr2, ' ' ' ,yr{i-l)), « = 1,2, • • • ,n. 

The sets of codewords are denoted by the codebook C = {(xi(u), X2(v)) : u G W", v e V"}. 

2) Power constraint Pi, P2 and P,. at the transmitters, i.e.. 



E 



1 " 



n 
1=1 



||2 
Jill 



<A, j = l,2,r, (13) 



where E is the expectation operation over the distribution induced by U", V". 
3) A decoding function 

□ 

Upon reception of the received vector Y", the receiver decodes (U",V") = ggiY"^) as the transmitted 
source outputs. The probability of an erroneous decoding depends on 6 and is given by 

P2{e) = p{(u", V") ^ (u", v")|6>} 

J] p(u",v")xP{(U",V")/(u",v") |(u",v"),0}. 

(u",v")6W"xV" 

Definition 3: We say the source of i.i.d. discrete random variables with joint probability mass 

function p{u, v) can be reliably sent over the PI-MARC, if there exists a sequence of encoding functions 
£n — {x"(U"), X2 (V"), /i, /2, • • • ) /n} and decoders g^ such that the output sequences U" and V" of the 
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source can be estimated with asymptotically small probability of error (uniformly over all parameters 9) at 
the receiver side from the received sequence Y", i.e., 



e 



0, as n — )• oo. (14) 



□ 

Theorem 2: Reliable communication over a PI-MARC: Consider a PI-MARC with power constraints 
Pi,P2,Pr on the transmitters, fading amplitudes gi,g2,gr > between the nodes and the receiver and 
9ir , 92r > between the transmitter and the relay, and the gain conditions 

glPi>glPi+9^Pr, (15) 
gl,Pi>glPi+glPr. (16) 

A necessary condition for reliably sending the source pair (U,V) ~ Y\.iP{'^i^'^i)^ '^^^^ ^ PI-MARC, is 
given by 

H{U\V) < log(l + (gfPi + glPr)/N), (17) 
H{V\U) < log(l + {glP2 + glPr)/N), (18) 
H{U, V) < log(l + {gfPi + (7i^2 + glPr)/N). (19) 

Moreover, ([T7l)-(fT9l) also describes sufficient conditions for reliable communications with < replaced by <. 

□ 

Proof: The theorem is the same as |fT5^, Theorem 4]. ■ 
In Sections |IV] and |Vl we study a more general version of the PI-MARC in which the transmitters 
cooperate in a specific way. Indeed, we consider a pair of correlated sources to be communicated over a 
phase incoherent (PI) multiple access relay channel where one of the transmitters has causal or non-causal 
side information about the message of the other. We refer to such channels as UC-MARC. In the non-causal 
case (see Fig. O, there is no path between the transmitters and the first encoder knows both sources outputs 
U, V, whereas in the causal case (see Fig. |6ll, the first transmitter works as a relay for the other while 
communicating its own information. For the situations where the channel gains between the relay and the 
transmitters are large enough, we prove that the separation approach is optimal. This may correspond to the 
physical proximity of the relay and the transmitters to each other. For the causal case, we have an additional 
condition on the gain between the encoders. The phase fading information is not known to the transmitters 
while it is known at the receivers. 



IV. UC-MARC WITH NON-CAUSAL SIDE INFORMATION 

In this section, we study the PI-UNCC-MARC introduced in Section III-FI with the pair of arbitrarily 
correlated sources ([/, V). The definition of a joint source-channel code for the PI-UNCC-MARC is identical 
to the one defined for a PI-MARC in section IIII-AI except for the definition of the encoding function xi 
which is replaced by 
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(Xii, Xi2, • • • , Xin) = x"(U, V). 

Theorem 3: Reliable Communication over a PI-UNCC-MARC: Consider a PI-UNCC-MARC with non- 
causal cooperation and with power constraints Pi,P2, Pr on transmitters and relay, fading amplitudes 
51 1 52 5 Qr > between the nodes and the receiver and gir , g2r > between the transmitter and the relay. 
Moreover, assume the gain conditions 

9lrPl>9lPl+9rPr, (20) 

glPi + glP2 > gfPi + g^Pi + ff'^r- (21) 
A necessary condition for sending a source pair (U, V) ~ YliP{ui,Vi), over such PI-UC-MARC is given 

by 

H{U\V) < log(l + {gfPi + glPr)/N), (22) 
H{U, V) < log(l + {gfPi + (7i^2 + 9lPr)/N). (23) 

Furthermore, eqs. (l22l)-([23]) also give the sufficient conditions for reliable communications over such PI-UD- 
MARC with < replaced by <. □ 
The proof of the theorem is divided into two parts: achievability and converse. The achievability part is 
obtained by a separate source and channel coding approach. The source coding part involves Slepian-Wolf 
coding followed by a channel coding technique which is based on the block Markov coding. The converse 
and achievabiUty parts of Theorem |2] are discussed and proved in the sequel. 

A. Converse 

We derive an outer bound on the capacity region of the PI-UC-MARC (both causal and non-causal) under 
gain conditions (|201)- (|2T]) and prove the converse part of Theorem |3] 

Lemma 2: Converse: Let Sn, and g^ be a sequence in n of encoders and decoders for the PLUC-MARC 
for which supg P^i'S) — > 0, as n — > oo. Then 

H{U\V) < mmI{Xi,Xr;gie^'^'Xi + ^^e-^'^-X^ + Z), 



HiU, V) < min/(Xi, X2, X,; ^le-^'^^Xi + g2e^^'X2 + ^rC-^'^-X, + Z), 



for some joint distribution pxi,X2,Xr- such that E|Xip < Pi,ElX2|^ < P2,E\Xr\'^ < Pr, with Z ~ 
CJ\f{0,N). □ 
Proof: 

First, fix a PLUC-MARC with given parameter 6, a codebook C, and induced empirical distribution 
Pe{u, V, xi, X2, Xr, y) by the codebook. Since for this fixed choice of 9, P^{f^) — ^ 0, from Fano's inequality, 
we have 

-H{V,V\Y,e) < -P,^ie) log IliY" X V"!| + - ^ e„(0), (24) 
n n n 
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and e„(0) — )• 0, where convergence is uniform in 6 by (fT4l ). Defining sup^ e„(0) = and following the 
similar steps as in 15] Section 4], we have 



H{u\v) = -Hmm 

n 

(a) 1 



H{\J\Y,X2,e) 

n 

= -/(U; Y|V,X2,0) + -i/(U|V, Y,X2,0) 

n n 

1 . 

< -I U;Y V,X2,6> +en 

n 

< il(Xi;Y|V,X2,0)+e„ 

n 

<-/(Xi,X,;Y|V,X2,0) + en, 

n 



(25) 



where (a) follows from the fact that X2 is only a function of V, (b) follows from (l24l l. and (c) follows 
from data processing inequality. Similarly, it can be shown that 



H(U, V) = i/(U, V; Y|0) + -H(\J, VlY, 6) 

11 n 

<i/(Xi,X2,X,;Y|0) + e„. 

n 



(26) 



We now define the region Cn{0) as 



1 



Cn{e) = {Ri,R2) : i?i < - I(Xi-;Y"|V-,X2",0) +en, 



n 



>yr{i-l))- 



ii2<-/(Xi",X2";Y"!0) + e, 
n 

for the empirical distribution induced by the nth codebook 

n n 
i=l i=l 

Hence, the outer bounds (|25]) and ( |26b can be equivalently described by C„(0): 

{H{U\V),H{U,V))(^Cn{e). 

We then note that the outer bound is true for all 6 and thus can be tightened by taking intersection over 
and letting n — ?> 00. We now further upper bound Cn{0) and then take the limit and intersection. 
First, we expand Y in the right hand side of ( |25] ) to upper bound H{U\V) as follows: 

H{U\V) < i /(Xi,X,;Y|V,X2,0) + en 

n 

= - /(Xi,X,;5ie^'^^Xi + 52e^''^X2 + (7re^''-X, + Z|V,X2) + e„ 

n 

= - /(Xi,X,;5ie^'^^Xi + 5,e^'^-X, + ZlV,X2) + e„ 



n 
_ 1 

n 

1 r 
< - 

n 



h{gie^^'Xi + grC^^'-Xr + Z|V, X2) - /i(Z) 



/i(5ie^'^iXi + grC^'^-Xr + Z) - /i(Z) 



+ en 



i /(Xi,X,;5ie^'^^Xi +5,,e-''^'-X, + Z) + 
n 



15 



1 

< -y^I{Xu,X„;gie^^'Xu+9re''^''Xri + Z^) + e. 



1=1 



(a) 



higie^^'Xi + ^re-^'^'-X, + ZilV) - h{Z)\ + e„ 



< 



+ en 



/i(c/ie-'''^Xi + ^^e-^'^-X^ + Z)- h{Z) 
= I{Xi,Xr;gie^''Xi + grC^'^Xr + Z) + e,, 
where (a) follows by defining new random variables 

Xj =Xjw, i e {l,2,r}, 
Z = Zw, 

W ^ Uniform{l, 2, • • • , n}. 
From ([T3] ). the input signals Xi,Xr satisfy the power constraints 



ElXi 



E 



1 " 



i=l 



<Pj, j = hr, 



and Z ~ CA^(0,A^). 

Moreover, following similar steps, we have 

H(U,V) = -H(U,V) 
n 

= -I(U,V; Y|0) + -H{\J,\\Y,e) 

n n 

< -/(U,V;Y|0)+e„ 

n 

< -I(Xi,X2;Y[0) + e„ 

n 

< -I(Xi,X2,X,;Y|0) + e„ 

n 



= - /(Xi, X2, X,,; 5ie^'^^Xi + 52e-''^X2 + gr-e^'^Xr + Z) + e„ 
n 

1 " 

< - V /(Xii, X2i, Xri; sie^^^^ii + <72e^^^X2i + grC^^^Xri + Zi) + e„ 



(27) 

(28) 
(29) 
(30) 

(31) 



< I{Xi,X2,Xr;gie^''Xi+g2e^"'X2+gre'''-Xr + Z) + en, (32) 

where the last step follows with the same RVs as in (|28])-(l30l). 

The constraints defined by (l27l ) and (l32l ) is an outer bound on C„(0). But since it appUes for a fixed 0, it 
is also true for all choices of 6. By taking intersection over all values of 9 and letting n — )• oo, the lemma 
is proved. ■ 

To prove the converse part of Theorem |2l we note by Lemma |2] that each of the bounds of Lemma |2] are 
simultaneously maximized by independent Gaussians. The proof of the converse is complete. 

Remark 2: Note that to prove the converse part of the Theorem |3l we do not need the receiver to know 
the CSI 6. This is indeed true for other separation theorems of the paper as well. □ 
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Encoder 


Block 1 


Block 2 


Block B 


Block B + 1 


1 


Xi(l,H/ll,W21,l) 


MWll,Wl2,W22..W2l) 


Xl(Wi(s_i), Wis, W2B,W2(B-1)) 


^i{Wib,1,1,W2b) 


2 


X2(l,W^2l) 


X2{W21,W22) 


X2(W"2(s_i), W"2i3) 


X2(W2S,1) 


r 


x.(l,l) 


MWii,W2i) 


Xr(VKi(B_i), VK2(B_i)) 


X,.(WlS,W2s) 



TABLE I 

Block Markov encoding scheme for UNCC-MARC. 



B. Achievability 

We now establish the same region as achievable for the PI-UNCC-MARC with non-causal cooperation 
between the encoders. To derive the achievable region, we perform separate source-channel coding. The 
source coding is performed by Slepian-Wolf coding and the channel coding argument is based on regular 
block Markov encoding in conjunction with backward decoding ifTTl . Both source coding and channel coding 
schemes are explained as follows. 

Source Coding: Recall that the first encoder has non-causal access to the second source V. From Slepian- 
Wolf coding |[T9l . for asymptotically lossless representation of the source ((U, V), V), we should have the 
rates (i?i,i?2) satisfying 

Ri > H{U\V), 
Ri + R2> H{U,V). 

The source codes are represented by indices Wi , W2 which are then channel coded before being trans- 
mitted. 

Channel Coding: An achievable region for the discrete memoryless UC-MARC with 2 users is given 
based on the block Markov coding scheme shown in Table U combined with backward decoding. 

First fix a distribution p{xi)p{x2)p{xr) and construct random codewords xi,X2,Xr based on the cor- 
responding distributions. The message Wi of each encoder is divided to B blocks Wii,Wi2, ■ ■ ■ ,WiB of 
2"^' bits each, i = 1,2. The codewords are transmitted in i? + 1 blocks based on the block Markov 
encoding scheme depicted in Table U Using its non-causal knowledge of the second source, transmitter 1 
sends the information using the codeword xi(Tyi(j_i), Wu, W2t, M^2(t-i))' while transmitter 2 uses codeword 
^2{W2(t-i),W2t) and the relay sends the codeword Xr(Tyi(j_i), W2(t-i))- We let i? ^ oo to approach the 
original rates i?2- 

At the end of each block b, the relay decodes Wib,W2b, referred to as forward decoding HI. Indeed, at 
the end of the first block, the relay decodes Wu, W21 from the received signal Yr{Wib, W2b)- In the second 
block, nodes 1 and 2 transmit :x-i{Wu,Wi2,W22,W2i) and X2 (1^21, ^22), respectively. The relay decodes 
W12, W22, using the knowledge of Wu, W21, and this is continued until the last block. Using random coding 
arguments and forward decoding from the first block, for reliable decoding of messages W2(b_i) 
at the relay after the 6th block, when n ^ 00, it is sufficient to have 

Ri<I{Xr,Yr\X2,Xr,e), (33) 
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Ri+R2< I{Xi,X2;Yr\Xr,e). (34) 

The decoding at the destination, however, is performed based on backward decoding |[T3l . |[23l . i.e., 
starting from the last block back to the former ones. As depicted in Table H at the end of block B + 1, the 
receiver can decode Wib,W2b- Afterwards, by using the knowledge of Wib,W2b, the receiver goes one 
block backwards and decodes W^i(b-i)7 W^2(B-i)- This process is continued until the receiver decodes all of 
the messages. Thus, by applying regular block Markov encoding and backward decoding as shown in Table 
H one finds that the destination can decode the messages reliably if n ^ oo and 

Ri<I{Xi,Xr;Y\X2,e), (35) 
Ri + R2<IiXi,X2,Xr;Y\e). (36) 

The achievability part is complete by first choosing Xi,X2, and Xr as independent Gaussians and 
observing that under conditions (|20l ) and (|2TI ). (|35] ) and (|36l ) are tighter bounds than ( [33] ) and ( [34l ). 

As a result of Theorem |3j in the following corollary, we state a separation theorem for the PI-UNCC-MAC 
introduced in Section III-CI with non-causal cooperation between encoders. 

Corollary 1: Reliable Communication over a PI-UNCC-MAC: Necessary conditions for reliable commu- 
nication of the source {U,V) over a PI-UNCC-MAC with power constraints Pi,P2 on transmitters, fading 
amplitudes gi,g2 > 0, and source pair (U, V) ~ YliP{ui,Vi), are given by 

H{U\V) <log{l + glPi/N), (37) 
H{U, V) < log(l + {glPi + glP2)/N). (38) 

Sufficient conditions for reliable communication are also given by (I56l)-(|57]). with < replaced by <. □ 
Proof: 

The PI-UNCC-MAC is equivalent to a PI-UNCC-MARC where the relay has power constraint Pr = 0. 
As the relay is thus silent, we may assume without loss that gi^ , g2r are arbitrarily large, and the conditions 
( |20l ) and (|2T]) are trivially satisfied. ■ 

V. UC-MARC WITH CAUSAL SIDE INFORMATION 

In this section, we state and prove a separation Theorem for another class of UC-MARC in which the 
encoders cooperate causally and by means of a wireless phase fading link between transmitters 1 and 2. 
Unlike the noncausal case discussed in Section III-F[ Xu is a function of the source signal U and its past 
received signals Y\ . In the sequel, we sate and prove a separation theorem for the causal PI-UD-MARC 
under specific gain conditions. 

Theorem 4: Reliable communication over a PI-UCC-MARC: Consider a PI-UCC-MARC with power 
constraints Pi,P2,Pr on transmitters and the relay, fading amplitudes gi, 52, 5^ 5ir, 52r, 92i > as shown 
in Figure [6j and source pair (U, V) '-^ YliPi.'^i^'^i)- Furthermore, assume the gain conditions 

glPi>glPi+glPr, (39) 
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Encoder 


Block 1 


Block 2 


Block B 


Block B + 1 


1 


Xl(l,Ml,l) 


Xl(W^ll,M2,W^2l) 


Xl(W^l(S-l), WlB, W2(S-1)) 


Xi(M/ls,l,W/2s) 


2 


X2(l,VP^2l) 


X2(W21, M^22) 


X2(W"2(s_i), W"2i3) 




r 


x.(l,l) 


X,(W^ll,VF2l) 


Xr(M^i(B_i), VK2(B-1)) 


MWiB,W2b) 



TABLE II 

Block Markov encoding scheme for UCC-MARC. 



gl.Pi > gfPi + glPi + glPr, (40) 
1 + ^ > 2-^(^1^) + 9lPi+9lP2 + glPr ^ ^4^^ 

Then, a necessary condition of reliable communication of the correlated sources (U, V) over such channel 
with or without knowledge of 6 at the receiver, is given by 

H{U\V) < log(l + gjPi + g^.Pr/N), (42) 
H{U, V) < log(l + (gfPi + 51^2 + 9^rPr)/N). (43) 



Conversely, (|42l) and (1431 ) also describe sufficient conditions for the causal PI-UCC-MARC with < replaced 
by <. □ 
Proof: 

Converse: The proof of the converse part of Theorem |4] is exactly the same as that of Theorem [3l as all 
of the steps remain unchanged in the causal setting. 

Achievability: For the achievability part, similar to Section IIV-B[ we use separate source and channel 
coding. We need to show that given (|42]) and (l43l) . we can first losslessly source code the sources to 
indices Wi G [l,2"^i],T^2 G [1,2"-^^^] and then send Wi,W2 over the channel with arbitrarily small error 
probability. 

Source Coding: Using Slepian-Wolf coding |[T9l . for asymptotically lossless representation of the source 
(U, V), we should have the rates (i?i,i?2) satisfying 

Ri > H{U\V), (44) 

R2 > H{V\U), (45) 

Ri + R2> H{U,V). (46) 

Channel Coding: Similar to that given in Section IIV-BI for the noncausal PI-UC-MARC, the channel 
coding argument is again based on block Markov coding with backward decoding as shown in Table |lll 
Since V is not perfectly and non-causally known to the first encoder, node 1 needs to first decode W2t after 
block t from its received signal over the link between the encoders. In order to guarantee correct decoding 
at the relay and correct backward decoding at the destination, using standard random coding arguments, the 
following conditions should be satisfied: 

Ri<I{Xi-Yr\X2,Xr,e), (47) 
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R2<I{X2;Yr\Xi,Xr,e), (48) 

Ri+R2< IiXi,X2;Yr\Xr,e), (49) 

for decoding at the relay and 

Ri<I{Xi,Xr;Y\X2,0), (50) 

Ri + R2<IiXi,X2,Xr;Y\e). (51) 

for decoding at the destination respectively. 

Additionally, to reliably decode the second encoder's message at the first encoder (which plays the role 
of a relay), we need to satisfy the condition 

R2<IiX2;Yi\Xi,Xr,e). (52) 

Computing these conditions for independent Gaussian inputs and using conditions (|39l ) and (|40l ). we find 
the following achievable region for channel coding: 

Ri < log(l + {glPi + glPr)/N), (53) 
R2<\og{l + gl^P2/N), (54) 
Ri + R2< log(l + {glPi + glP2 + gjPr)/N). (55) 
In order to make the inner bounds of (I53l)-(l55l) coincide with the outer bounds (|42]) . (|43] ). we need to have 

log(l + (gfPi + giP2 + g^rPr)/X) - Ri < log(l + gliP2/N), 

so that we can drop (l54l ) from the achievability constraints. But by choosing Ri = H{U\V) + e, with 
e > arbitrary, condition (|4T]) makes (|54l ) dominated by ( [55l ) for the Gaussian input distributions. Therefore, 
since e > is arbitrary, one can easily verify that given (l42l ) and ( [431 ) with < replaced by <, along with 
the conditions ([39l)-(l4TI). source and channel codes of rates i?i,i?2 can be found such that (I44l)-(l46l). and 
(|47l)-(l52l) simultaneously hold. ■ 
Corollary 2: Reliable communication over a PI-UCC-MAC: Necessary conditions for reliable communi- 
cation of the sources {U,V) over the causal PI-UCC-MAC with power constraints Pi,P2 on transmitters, 
fading amplitudes gi,g2 > 0, and source pair (U, V) ~ YliP{ui,Vi), is given by 

H{U\V) <log{l + glPi/N), (56) 

H{U, V) < log(l + {glPi + glP2)/N), (57) 

provided 

1 + ^ > 2-^(^1^) (^1 + i^Lt^^ . (58) 

Given (l58l) . sufficient conditions for reliable communications are also given by (l56l) and dSTl ). with < 
replaced by <. □ 
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Proof: 

The argument is similar to the proof of the Corollary [T] The PI-UCC-MAC is equivalent to a PI-UCC- 
MARC where the relay has power constraint Pr = 0. As the relay is thus silent, we may assume without 
loss that gir,g2r are arbitrarily large. The conditions (|39l)-(l40l) of Theorem |4] with (|4TI ) being changed to 
(|58] ) are then trivially satisfied. ■ 

VI. Interference Channel 

We now study the communication of the arbitrarily correlated sources {U, V) over a phase-asynchronous 
interference channel introduced in Section III-GI The definition of the joint source-channel code and power 
constraints are similar to the ones given in Section IIII-AI However, since there are two decoders in this 
setup, we define two indexed decoding functions ^ and g^ ^ ^^id two error probability functions 

P^^{e2) = P{V" / V"|6»2} = Yl ^(^") ^ ^ ^" |v",6'2}. 

(v")GV" 

for each of the corresponding receivers. 

Consequently, reliable communications for the PI-IC is defined as: 

Definition 4: We say the source {Ui,Vi}f^i of i.i.d. discrete random variables with joint probability 
mass function p{u, v) can be reliably sent over the PI-IC, if there exists a sequence of encoding functions 
£n — {x"(U"), X2 (V")} and decoders gg^,gg^ such that the output sequence U" can be reliably estimated 
at the first receiver and V" can be reliably estimated at the second receiver over all parameters 6i , 02 
respectively. That is. 



supPil(0i) 
e 

SUpPr2(^2) 

e 



0, as n 
0, as n 



oo, 



oo. 



(59) 

(60) 

□ 



Theorem 5: Reliable Communications over a PI-IC: A necessary condition of reliably sending arbitrarily 
correlated sources {U,V) over a PI-IC with power constraints Pi,P2 on transmitters, fading amplitudes 
911)512,521,522 > 0, and source pair (U, V) ~ YliP{ui,Vi), with the strong interference condition 



511 > 512 

522 > 521 

with or without knowledge of 6 at the receiver, is given by 

H{U\V) <log{l +glPi/N), 
H{V\U)<log{l + gl2P2/N), 



(61) 
(62) 

(63) 
(64) 
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H{U, V) < mill {log(l + {gl^Pi + g2^P2)/iV), log(l + {gf^Pi + 522^2)/iV)} • (65) 
The same conditions (|63])-(|65]) with < replaced by < describe the achievabiUty region. □ 

A. Converse 

In this section, we derive an outer bound on the capacity region and prove the converse part of Theorem 
|5]for the interference channel. 

Lemma 3: Converse: Let {x"(u"), X2 (v")}, and ggi,gg2 sequences in n of codebooks and decoders 
for the PI-IC for which ^ and hold. Then we have 

H{U\V) < min/(Xi;e^'^"Xi + Z), (66) 
01 

H{V\U) < mmI{X2;e^^''X2 + Z), (67) 
H{U, V) < min|min/(Xi, X2; e^^^'Xi + g2ie^^''X2 + Z), min/(Xi,X2; gueJ'^'^Xi + e^^^^X2 + Z) 

01 02 

(68) 

for some joint distribution pxi,X2 such that E|Xip < Pi, E|X2p < P2- □ 
Proof: 

First, fix a PLIC with given parameters (^1,^2), a codebook C, and induced empirical distribution 
P0(u, V, xi, X2, yi, y2). Then, we note that by using the strong interference conditions of ( [6T] ) and ( [62l ). 
one can argue that both of the receivers can decode both of the sequences U, V provided there are encoders 
and decoders such that each receiver can reliably decode its own source sequence (see lITSl for details). 
Thus, U, V can both be decoded from both Yi,Y2. Thus, we have the intersection of two PLMACs and 
the result follows from Theorem [T] ■ 



B. AchievabiUty 

The achievabiUty part of Theorem |5] can be obtained by noting that if we make joint source-channel codes 
such that both receivers are able to decode both messages, then we will have an achievable region. Thus, the 
interference channel will be divided to two PLMACs and the achievable region will be again the intersection 
of the achievable regions of the two PLMACs as given in Theorem [1] 

VIL Interference Relay Channel (IRC) 

In this section, we prove a separation theorem for the PI-IRC introduced in Section III-HI under some 
non-trivial constraints on the channel gains which can be considered as a strong interference situation for 
the IRC. The definitions of reliable communication and joint source-channel codes for the PI-IRC are similar 
to those for the PI-IC. We first state the separation theorem and consequently give the proofs of the converse 
and achievabiUty parts. 

Theorem 6: Reliable communication over a PI-IRC: Consider a PI-IRC with power constraints Pi ,P2,Pr 
on transmitters, fading ampUtudes gu , 521 , 912 , 522 > between the transmitters and the receivers, gri , gr2 > 
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between the relay and the receivers, and gir,g2r > between the transmitters and the relay. Assume also 
that the network operates under the gain conditions 

— = — = a < 1, (69) 

912 5r2 

gfiPi + gjiPr < glPi, (70) 

g^22P2 + g^2Pr < 9lrP2, (VI) 

(1 - a^) gl^Pi < a^gl^Pr, (72) 
(1 - a^) ghP, (1 - g^) 

5 1 5 r 522 ^ 521- 

Then, a necessary condition for rehably sending a source pair (U, V) ~ YliPi'^i^'^i)' over such PI-IRC 
is given by 



H{U\V) < log(l + [g^Pi + g^riPr)/N), (74) 

< log(l + (5i2^2 + gl2Pr)/N), (75) 

y) < log(l + {gl^Pi + 5i2^2 + gl2Pr)/N). (76) 

Moreover, a sufficient condition for reliable communication is also given by d74l)-(r76l). with < replaced by 
<, when 6 is known at the receivers. □ 
The proof of Theorem [6] is discussed in the two following subsections. First, the converse is proved and 
afterwards, we prove the achievability part of Theorem [6] 

A. Converse 

Lemma 4: PI-IRC Converse: Let £n be a sequence in n of encoders, and giQ,g20 be sequences in n of 
decoders for the PLIRC for which sup^ P]\(0), — > 0, as n ^ oo, then we have 

H{U\V) < mill I{Xi,Xr;giie^^''Xi + g^ie^'^'^^X,. + Z), (77) 

H{V\U) < mill I{X2,Xr;g22e^^''X2 + gr2e^^''Xr + Z), (78) 

H{U, V) < mill I{Xi,X2, Xr;gi2e^'''Xi + 522e^'^^X2 + gr2e''^'Xr + Z), (79) 

for some j'omf distribution pxx,x^,x, such that < Pi,E|X2|^ < P2,E|-^rP < Pr, where — : 

^11 = ^12, ^rl = ^r2}- □ 

First, fix a PLIRC with given parameter 6 G a codebook C, and induced empirical distribution 
P0(u, V, xi, X2, Xr, yi, y2). Since for this fixed choice of 6, P^i{0) , P^2{^) ~^ 0' from Fano's inequality, 
we have 

-H{lJ\Yi,e) < ip«(0)log||ZY"|| + - ^ ei„(0), 
n n n 

-H{V\Y2,e) < ip,"2(0)log||V"|| + e2n{e), 
n n n 
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and ei„(0), e2n(^) 0, where convergence is uniform in 6. Defining supQein{0) = ein,i 
following similar steps as those resulting in (|25] ). we have 



1,2 and 



H{U\V) < i/(Xi,X,;Yi|V,X2,0) + ei„, 
n 

H{V\U) < -/(X2,X,;Y2|U,Xi,0) + e2„. 

n 



(80) 
(81) 



As in Section HV-AI we can upper bound dSOl ). dSTT ) and derive dTT] ) and dTSl ). Next, to derive ( 1791 ), we define 
a random vector Zi ~ CA/'(0, (1 — a)Nl) with I the n x n identity matrix, and bound H{U, V) as follows: 

n 

= -H(Y) + -i/(U|V) 

n n 

= -H(V) + -H(U\V,X2) 

n n 

= -I{\-Y2\e) + i/(U;Yi|V,X2,0) + -H{\\Y2,e) + -/7(U|V, X2, Yi, 0) 

n n n n 

< i/(X2; Y2I0) + i/(Xi; Yil V, X2, 0) + em + £2™ 

n n 

< -/(X2; Y2|6>) + -/(Xi, X,; Yi |V, X2, 6>) + em + e2n 

n n 

< i/(X2; Y2I0) + i [/i(Yi|X2, 61) - /i(Zi)] + em + e2n 
n n 

= -/(X2; Y2I0) + i/(Xi, X,; Y1IX2, 6) + em + e2„ 

n n 

< i/(X2; Y2I0) + i/(Xi,X,;5ne^'^"Xi +5,ie^'^-X, + ZijXa) + ei„ + e2„ 

n n 

il(X2; Y2) + i/(Xi,X,;5ne^'^"Xi + <7,ie^'-^X, + aZi + Z1IX2) + em + e2n 

n n 

-I(X2; Y2) + -/(Xi,X,;9ne^'^"Xi + <7,ie^'^-X, + QZ2 + ZijXs) + em + £2™ 

n n 

il(X2; Y2) + i/(Xi,X,;a5i2e^'^-Xi + agr2e^'"^Xr + aZ2 + Z1IX2) + ei„ + £2,, 
n n 

-I(X2; Y2) + -/(Xi,X,;a5i2e^'^-Xi + Q5,2e^'''-^X, + aZ2|X2) + em + e2„ 
n n 

= -/(X2; Y2) + -I(Xi, X,; aYslXs) + ei„ + e2n 

n n 

il(X2; Y2) + i/(Xi, X,; Y2IX2) + em + e2n 

n n 

= — -^(Xi, X2, Xr; Y2) + em + e2n, 
n 



(82) 



(83) 



(84) 



where (a), (b) follows from the fact that by preserving the noise marginal distribution, the mutual information 
does not change. The noise term Zi in (l82l ) is thus divided into two independent terms aZi + Zi, and then 
Zi is replaced by Z2 to obtain (|83] ). Also, (c) follows from (l69l ) and the fact that in On = 612 and 
^ri = ^r2> (d) follows sincc reducing the noise may only increase the mutual information, and (e) follows 
from the fact that linear transformation does not change mutual information: I{X\ Y) = I{X; aY). 
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Encoder 


Block 1 


Block 2 


Block B 


Block B + 1 


1 


xi(l,V|/ii) 


Xl(W^ll,Wl2) 


Xl(Wi(_g-l), Wib) 


Xl(W/lB,l) 


2 


X2(l,W2l) 


X2(M^21, W22) 




X2(W^2B,1) 


r 


X.(l,l) 


X.(W^ll,W2l) 


Xr(W^l(S-l), W2(s_l)) 


X.(mB,W^2fl) 



TABLE III 

Block Markov encoding scheme for IRC. 



We can now further upper bound H{U, V) by the fact that the upper bound I{6) is true for all values of 

H{U,V) < mill |-/(Xi,X2,X,;Y2)| +ei„ + e2n 

< min < - I{Xii,X2i,Xri; Y2i) > + ein + e2n 

min I{Xi,X2,Xr;Y2\W) + em + e2n 
= min [h{Y2\W) - h{Z)] + + e2n 

< min [h{Y2) - h{Z)] + ei„ + e2„ 

= min I{Xi,X2,Xr; Y2) + ei„ + e2n 

where (a) follows by defining the time-sharing RV W and RVs Xi,X2,Xr as in (l28])-(l30ll with the power 
constraints similar to (OTI ). By letting n — )• 00, the proof of the lemma is complete. ■ 
Using the key lemma, we maximize the upper bounds of Lemma |4] with the independent Gaussians and 
the proof of the converse part is complete. 

B. Achievability 

The achievability part is again proved by separate source-channel coding: 
Source Coding: Using Slepian-Wolf coding, the source (U, V) is source coded, requiring the rates R2) 
to satisfy (I44l)-(l46l). 

Channel Coding: Using the block Markov coding shown in Table JII] in conjunction with backward 
decoding at the receivers (note: both receivers decode all messages) and forward decoding at the relay, 
we derive the following necessary conditions to find reliable channel codes for a compound IRC with 2 
transmitters and a relay r: 

Ri < min {IiXr,Yr\X2,Xr, 0), /(Xi, X,; Yi\X2,e),I{XuXr; ^21^2, 0)} , (85) 

R2<mm{IiX2;Yr\Xi,Xr,e)J{X2,Xr;Yi\Xi,e),I{X2,Xr;Y2\Xi,e)}, (86) 

Ri + R2< min {/(Xi, X2; Yr\Xr, 0), /(Xi, X2, X,; /(Xi, X2, X,; Yaj^)} , (87) 

for some input distribution p{xi)p{x2)p{xr). 
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Computing the mutual informations in ([85l)-(l87]) for independent Gaussians Xi '-^ CM{0,Pi), X2 ~ 
CJ\f{0,P2), Xr ~ CMiO,Pr), we find by ^ and dH that 

/(Xi ■,Yr\X2,Xr,e)>I{Xi, Xr ; ^ [Xs , 0) , 

/(Xi, X,; y2|^2, e) > i{Xi,Xr; Yi\X2,e), 

respectively, and by dTTI) and (1731 ) that 

I{X2 ; [Xi , Xr , 0) > /(X2 , X, ; ^2 1^1 , 0) , 
/(X2,X,;yi[Xi,0) >/(X2,X,;y2lXi,0), 
respectively. Also, the conditions (ITOll-dTll) together result in 

/(Xi,X2;y.|X,,0) >/(Xi,X2,X,;y2|0), 

while the condition (1731) makes 

/(Xi,X2,X,;yi|0) >/(Xi,X2,X,;y2[0). 

Hence, due to dTOll-dTS]). the larger terms will drop off from the constraints ([85])-(l87]) and we may rewrite 
the sufficient conditions as 

i?l <log(l + (5?iA+5rl^rO/iV), 
R2 < log(l + {g^22P2 + 9r2Pr)/N), 
Rl+R2< log(l + (5?2A + ghP2 + 9r2Pr)/N). 

Thus, combining the source coding and channel coding, the achievable region is the same as the outer 
bound and the proof of Theorem [6] is complete. 

VIII. CONCLUSION 

The problem of sending arbitrarily correlated sources over a class of phase asynchronous multiple- 
user channels with non-ergodic phase fadings is considered. Necessary and sufficient conditions for re- 
liable communication are presented and several source-channel separation theorems are proved by ob- 
serving the coincidence of both sets of conditions. Namely, outer bounds on the source entropy content 
{H{U\V), H(y\U), H{U, V)) are first derived using phase uncertainty at the encoders, and then are shown 
to match the achievable regions required by separate source-channel coding under some restrictions on the 
channel gains. Although, our results are for fixed 6, they are also true for the ergodic case: 

Remark 3: In all of the above theorems, we assumed that the vector is fixed over the block length. It 
can be shown that the theorems also hold for the ergodic phase fading, i.e., the phase shifts change from 
symbol to symbol in an i.i.d. manner, forming a matrix of phase shifts 0. The achievability parts of the 
theorems remain unchanged by the assumption of perfect CSI at the receiver(s), while in the proofs of the 
converses, the expectation operation over is used instead of taking the minimum (as in |2|). One can 
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then use the results of Remark [T] as a key lemma to prove the optimality of independent Gaussians for the 
converse parts. □ 
As a result, joint source-channel coding is not necessary under phase incoherence for the networks studied 
in this work. We also conjecture that source-channel separation is in fact optimal for all channel coefficients 
and not only for the constraints presented in this paper. 
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